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APPARATUS, SYSTEM, AND METHOD FOR DRAPING ANNOTATIONS ON TO A 



FIELD OF THE INVENTION 

This invention relates to the field of geometric modeling. More specifically, the invention relates 
to computation, visualization and/or annotation of geometric models. 

BACKGROUND OF THE INVENTION 

In CAD/CAM (Computer Aided Design/Computer Aided Manufacturing) and many other 
industries, one needs to view and interact with three-dimensional (3D) models obtained from a 
local machine or a remote server. These 3D models contain both geometry and surface features. 
The geometry of a model defines its shape, typically as a set of vertices and their connectivity. 
The connectivity of a model defines how the vertices are connected together to form the surface 
of the model. For example, vertices are often connected together as triangles or quadrilaterals. 
These surface shapes are often referred to as polygons. The surface features of a model contain 
additional information in the form of attributes and annotations. The attributes refer to data 
values specified for the geometry of the model, such as colors or normals. These values may be 
specified for each of the vertices, for each of the polygons, or for each vertex/polygon pair, also 
referred to as a corner. Annotations are used to provide further information about the model, 
often in the form of line segments or text mapped onto the surface of the model. For example, if 
the 3D model was of a geographic region, the annotations could include the roads, rivers, cities, 
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GEOMETRIC SURFACE 



and their names, for that geographic region. Another example, within the CAD/CAM domain, is 
to highlight the original mesh structure, i.e. wireframe, of a geometric model. This mesh structure 
contains line segments, also known as edges, between the vertices of the model. 

There is a growing need to represent complex three-dimensional models by simplified versions 
S that are less expensive to store in memory on a computer, faster to transmit across a network 
from one computer to another computer, and faster to render on a computer. To address this 
great need, many techniques have been developed to simplify a model with minimal loss in 
perceived quality. See, for example, U.S. Pat. No. 5,929,860 or the article "Surface 
f n Simplification Using Quadric Error Metrics," by M. Garland and P. Heckbert, in Computer 

f rs 

101 Graphics Proceedings, Annual Conference Series, 1997, pages 209-216. Such techniques attempt 

'% = 
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jjf to reduce the geometry of the model so that when the simplified model is rendered on a computer, 

5.. -Ji 

\± the viewer will be able to perceive few, if any, differences as compared to a rendering of the 

P 

1 1 original model. To accomplish this goal, many of the simplification techniques take the attributes 

£3 of the model into account as well when simplifying the geometry. See, for example, U.S. Pat. No. 

15 6,100,902; P. Cignoni, C. Montani, C. Rocchini, and R. Scopigno, "A General Method for 
Preserving Attribute Values on Simplified Meshes", Proceedings of IEEE Visualization, pages 
59-66, 1998; M. Garland and P. Heckbert, "Simplifying Surfaces with Color and Texture Using 
Quadric Error Metrics," Proceedings of IEEE Visualization, pages 264-269, 1998; and H. Hoppe, 
"New Quadric Metric for Simplifying Meshes with Appearance Attributes," Proceedings of IEEE 

20 Visualization, pages 59-66, 1999. These techniques let the attributes guide the simplification 
process so that the geometry and the attributes of the simplified model appear the same as in the 
original model. To further preserve the overall appearance of the model, the annotations must be 
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mapped onto the simplified model when simplification techniques are utilized, since the 
annotations can convey a significant amount of information. 

To convey information about a model to the viewer, there is clearly a need to map the annotations 
of the model onto its original surface, or a simplified version of its surface in those instances when 
5 simplification has been utilized. We often refer to this mapping operation as "draping" the 
annotations onto the surface of the model. 

13 Texture mapping, thoroughly described by P. Heckbert in "Survey of Texture Mapping", IEEE 
m Computer Graphics and Applications, volume 6, number 1 1, pages 56-67, November 1986, 

refers to a technique for mapping an image onto the surface of a model. For example, let us say 
ljtf that we have a model of a wooden door. To convey the actual grain of the wood, we could 

include that within the model itself, however this would require a significant amount of additional 
M geometry. To avoid this added complexity, texture mapping allows us to take a small image of 
O the wood grain and map this onto the entire model so that the rendered image appears the same as 

if we used geometry to convey the wood grain. 

1 S Texture mapping has been commonly used to map annotations onto the surface of a model. To 
accomplish this, the annotations are first rendered as an image and stored in the memory of a 
computer. When the model is being viewed, the texture map of the annotations is applied to the 
surface of the model to convey the additional information provided by the annotations. Using 
such an approach, the annotations of a model can be mapped onto the original or simplified 

20 surface of the model, since they are stored in the form of an image. 
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PROBLEMS WITH THE PRIOR ART 



Texture mapping requires specialized graphics hardware for adequate performance during 
viewing, and that hardware is not currently guaranteed to be present on all computers. In 
addition, texture mapping requires rendering one or more views of the annotations from different 
5 viewpoints, and projecting the rendered images onto the surface via texture coordinates. When 
multiple images are used to represent the annotations of the model at the same time, differences in 
rendering parameters between images may result in a discontinuity where the images border each 

f 3 

j3 other and this discontinuity can stand out as a disturbing artifact. Annotations that do not appear 

fn 

^2 seamless may be hard to interpret because the eye is drawn to the abrupt changes in surface 

L\ : 
,'i 

1CH characteristics rather than the actual features on the surface. Consequently, the annotations may 

O 

» become an ineffective means for conveying the additional information to the viewer. 

u 

Q Texture maps also suffer from blurring and pixelization at high magnification. Since the 

■t; zz. 

u annotations are stored as an image, they are recorded at a fixed resolution. Typically the 

resolution of the image is measured in terms of the number of pixels in width and height. If the 

15 viewer zooms into the model to see the surface details more closely, the annotations texture map 
will appear blurry and unnatural. The end result is that the information conveyed by the 
annotations will be lost by the viewer. 
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Texture maps are most efficient for simple geometric models, 
additional images, from different viewpoints, will be required, 
discontinuity problem mentioned previously. 



For complex models, many 
This will greatly exacerbate the 



OBJECTS OF THE INVENTION 

An object of this invention is an improved system and method for draping, i.e., mapping, arbitrary 
annotations onto a surface. 

An object of this invention is an improved system and method for draping with an adequate 
amount of fidelity and with greater speed and simplicity. 

An object of this invention is an improved system and method for projecting the vertices of an 
annotation onto a surface and reconnecting the projected vertices to preserve the appearance of 
the original annotation on the surface. 

An object of this invention is an improved system and method for reconnecting the projected 
vertices of an annotation using the projected vertices and the midpoint of the original annotation 
line segments. 
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SUMMARY OF THE INVENTION 



Vertices of an annotation are projected onto a surface of a (2D or3D) model and reconnected to 
preserve the original appearance of the annotation. The result of our method is a new set of 
geometry for the annotation that geometrically conforms to the surface of the model. A plane is 
5 defined by the midpoint of the original line segment and the two projected vertices. This plane is 
used to create the new line segments that conform to the surface, e.g. by doing a "surface walk" 
between the projected points along the line defined by the intersection of the plane and the 
surface. 

2: a, 

l. i i; 
SO 

I ;ii This invention solves the annotation mapping problem geometrically and the results do not require 
W graphics hardware to visualize. Furthermore, the invention works well with arbitrary shapes and 

f does not suffer from blurring under high magnification. 

£3 

b 

n By maintaining the annotations as geometry, as opposed to textures, we also are able to simplify 
them while still maintaining the overall appearance of the model over a wide range of 
magnifications . At the same time, the invention does not preclude texture maps from being used 

15 to provide attribute information, such as color. 
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BRIEF DESCRIPTION OF THE FIGURES 



The foregoing and other objects, aspects, and advantages will be better understood from the 
following non-limiting detailed description of preferred embodiments of the invention with 
reference to the drawings that include the following: 

Figure 1 is a block diagram of a preferred system embodying the present invention; 

Figure 2 is an image showing an example of annotations draped onto the surface of a model; 

Figure 3 a is a close-up image of the same model in Figure 2, using prior art texture maps to 
convey the annotation information; 

Figure 3b is a close-up image of the model in Figure 2, using the current invention to drape the 
annotations as geometry onto the model; 

Figure 4 is a flow chart showing an annotation draping process; 

Figure 5 is an image of the projection of the annotation vertices; 

Figure 6 is an image of prior art that directly connects the projected annotation vertices; 

Figure 7 is a flow chart showing the cutting plane selection process; 
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Figure 8 is an image of the cutting plane used within the annotation reconnection process; 
Figure 9 is an image of a draped annotation on the surface of a model. 

DETAILED DESCRIPTION OF THE INVENTION 

Referring now to the drawings, and more particularly, Figure 1 is a block diagram of a preferred 
embodiment geometric modeling system 101 that includes a memory 104 where one or a plurality 
of geometric models are stored. One or more Central Processing Units (CPU) 1 02 access the 
model via the internal bus 105 and assist a graphics processor 103 in rendering the image and 
conveying it via the I/O subsystem 106 and the graphics accelerator 107 to the display 108. 
Optionally, the internal bus 105 may be connected to a network interface to transmit the 
geometric models across a network to remote modeling systems. These components are all 
well-known. A novel annotation draping process 400, described in more detail in Figure 4, is 
executed by one or more of the CPUs. 

Figure 2 shows an example 200 of annotations draped onto the surface of a model 230. The 
geometry of the model defines the actual shape of the surface. In this example, the geometry 
represents an undulating surface. The attributes for this model are the colors that give it the 
appearance of a brick wall. The annotations, e.g. 205, 210, are the line segments that are draped 
onto the surface of the model. Here, as an example, line segments form a triangular mesh 205 and 
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a curved line 210. After a novel draping process, described below, the projected annotations 215, 
220 maintain the same overall appearance as the original annotations 20S, 210. Models 230 are 
well defined in the art, as are annotations. However, the prior art superimposes these annotations 
on the surface with distortions. The annotation draping process disclosed removes these 
5 distortions. 

Figure 3a is a close-up image 330 of the model in Figure 2, using the conventional prior art 
technique of texture maps to convey the annotation information. In this illustration, the 
annotations 340 are rendered and stored as an image and then texture mapped onto the model 
I* geometry. Under high magnification, the annotations are distorted, appearing blurry and 

fq 

IjO^ pixelized, due to the fixed resolution of the texture map, which causes a distracting artifact in the 

m rendered image. The annotations appear very jagged when the viewer zooms into the image. The 

= lack of fidelity in representing the annotation caused by the texture map in this example can lead 

IE SS 

^ the viewer to make incorrect conclusions about what is being seen. 

C3 

IJ 

Figure 3b is a close-up image 350 of the model in Figure 2, using the current invention to drape 
1 5 the annotations 360 onto the model geometry. Since the annotations have been maintained as 
geometry, as opposed to texture maps, their appearance is cleanly preserved even at high 
magnification levels. As the viewer zooms into the model for a closer look, the annotations are 
rendered as geometry for the current viewing parameters and will therefore appear very smooth. 
They will not be seen as jagged, blurry edges, as in the prior art methods. The annotations are 
20 crisp and clean, and the viewer can more accurately determine what is being seen. 
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Figure 4 is a flow chart of the novel annotation draping process 400. The process accepts as 
input a geometric model 410 and one or more annotations 420. The annotations are specified as 
geometry, in the form of a set of vertices V and a set of edges E, which connect the vertices 
within V together to form the edges of the annotations. The process 400 of draping the 
5 annotations onto the surface of the model comprises three stages, which are discussed in further 
detail below. The point projection process 430 projects the set of vertices V onto the surface of 
the model. The cutting plane selection process 440 chooses a plane for each edge of the 
annotations to define the path of the draped edge along the surface of the model. The annotation 
reconnection process 450 reconnects the projected vertices of the annotation edges, using the 
10; plane selected in the previous process 440, to preserve the original appearance of the annotations. 

m 

""■4 

|;g The output 460 of the annotation draping process 400 is the geometric model with the 

I. —S 

annotations draped onto its surface. 

t 

i. _i 

;i Figure 5 is an image illustrating the point projection process 430. This first stage of the 
annotation draping process 400, described in Figure 4, projects the set of vertices V of the 

15 annotations onto the surface of the model. The surface of the model in this example comprises 
triangles, whose edges are shown as white line segments 5 10. In this illustration, the two vertices 
525 of an edge 520 of an annotation are projected onto the surface of the model. Arrows 530 
highlight the direction in which the annotation vertices 525 are projected onto the surface, 
resulting in two new vertices 555. Upon completion of the annotation draping process 400, the 

20 draped annotation edges appear as black line segments 540. 
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There are well-known prior art techniques for projecting arbitrary vertices onto a surface. 
In these techniques, the projection algorithm typically finds the nearest point on the surface to the 
original point. However, the criteria for projecting the vertices of an annotation are somewhat 
unique since one needs only a visually appropriate approximation of the projection, and one that 
avoids the creation of short segments during the annotation reconnection process 450 that appear 
when a projected point lands near the vertex or edge of a surface triangle. To meet these special 
criteria, we use a tolerance value, epsilon, based on a percentage of the average annotation edge 
length, that forces the projected vertices to snap first to the nearest surface vertex within epsilon 
of the projected vertex, and if no surface vertex is within that range, to snap the projected vertex 
to the nearest surface edge within the epsilon range. If the vertex does not snap to a surface 
vertex or edge, it simply projects directly into the nearest surface triangle. The annotation vertex 
525 on the right of Figure 5 projects near to a triangle edge and snaps onto the edge, while the 
vertex 525 on the left does not snap and remains in the interior of the triangle. Note that the 
draped annotation edges 540 appear crooked due to the low angle of view and the creases 
between adjacent triangles; from above, the draped edges appear straight. 

Once the annotation vertices are projected onto the surface of the model, the problem becomes 
how to reconnect them while conforming to the surface, yet retaining the straight appearance of 
the original annotation edges. Figure 6 shows a prior art technique in which the two projected 
vertices 555 of an annotation are directly connected without regard for the surface triangles 510 
shown as white line segments. The resulting edge 620, shown using transparency, penetrates 
deeply into the surface. Alternatively, the edge could also float high above the surface. Either 
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artifact stands out perceptually and would distort the information carried by the draped 
annotation. 



The problem of finding the shortest path between two points which conforms to a surface is 



known to be computationally expensive (see J. Chen and Y. Han, "Shortest Paths on a 
5 Polyhedron", Proceedings of Sixth Annual Symposium on Computational Geometry, pages 

360-369, 1990) and therefore cannot be used within a practical draping algorithm in a geometric 
modeling system. Since the goal is to efficiently produce a version of the annotation edges on the 
surface of the model that are visually consistent with the original, the requirement that the path be 
shortest in distance can be exchanged for a requirement that the path appear straight when viewed 
IjK from somewhere above the surface. 



CO 
C3 

s To fulfill this requirement, the current invention selects a cutting plane for each edge of the 

f « 

J 3 annotation to define the path of the draped edge along the surface of the model. The cutting 
plane selection process 440, defined using the flow chart in Figure 7, requires three inputs for 

*~ 

each edge of the annotations: the original annotation edge vertices (vO, vl) 705, the projected 
15 vertices (pO, pi) 710 from the point projection process 430 which correspond to vO and vl 
respectively, and the surface triangles (tO, tl) 715 that contain the projected vertices pO and pi 
respectively. 



The cutting plane must pass through the two projected vertices 710 of the annotation edge, 



however, with only two selected points, a plane cannot be defined. To properly define the plane, 
20 a third point must be selected. We do this by computing 720 the midpoint M of the original 
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annotation edge between vO and vl. Using pO, pi, and M, we can then compute 725 the cutting 
plane P for this annotation edge. In some instances, these three points may be collinear and not 
define a valid plane. We therefore must test 730 to see if P is valid. If P is not a valid plane, we 
use an alternative scheme that computes 735 the average normal N for the surface triangles tO and 
tl. The surface normal indicates the direction in which the triangle is facing. Using pO, pi, and 
N, we can then recompute 740 the cutting plane P for the annotation edge. We complete the 
cutting plane selection process 440 by returning the valid cutting plane P. 

Figure 8 illustrates the cutting plane selection process 440. The original annotation edge 520 and 
vertices (vO, vl) 525 are shown, as well as the projected vertices (pO, pi) 555 that correspond to 
the original vertices. Using the original vertices 525, the midpoint 840 of the annotation edge is 
computed. The cutting plane 860 is then computed using the projected vertices 555 and the 
midpoint 840 of the original edge. 

Pseudo-code for the cutting plane selection process 440 is included below. The input of this 
process are the annotation edge vertices (vi, yj), the projected annotation edge vertices (pi, pj), 
and the surface triangles (ti, tj) that contain pi and pj. The ComputeCuttingPlane function takes 
three points as input and computes the plane containing these points. This function is well-known 
in the art. The InvalidPlane function, which is also well-known, determines if the cutting plane is 
valid. The SelectNormal function chooses an appropriate normal to compute the cutting plane. 
This normal may be the normal of either of the surface triangles (ti, tj), or may be the average of 
the two surface normals. The valid cutting plane for the annotation edge is computed and 
returned by this process. 
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CuttingPlaneSelectionProcess(vi, yj, pi, pj, ti, tj) 
{ 

/* 

* This process selects the cutting plane to be used to drape the current annotation edge; 
5 * vi, yj are the annotation edge vertices; 

* pi, pj are the projected annotation edge vertices; and 

* ti, tj are the surface triangles that contain pi, pj. 
*/ 

D 
w 
u * 

^ midpoint = (vi + yj) / 2; 

cutPlane = ComputeCuttingPlane(pi, pj, midpoint); 

5 H 
■a — 

S 

f3 if(InvalidPlane(cutPlane)) 

3 

o { 

.= to. 

normal = SelectNormal(ti, tj); 
1 5 tempPoint = pi + normal; 

cutPlane = ComputeCuttingPlane(pi, pj, tempPoint); 

} 

return cutPlane; 

20 } 
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For each of the original edges of the annotation, we must reconnect the projected vertices to form 
the new draped edges that conform to the surface geometry. We have referred to this process as 
the annotation reconnection process 450. This process, illustrated in Figure 9, can be thought of 
as walking along the surface of the model, since our algorithm begins at one of the projected 
endpoints and walks from triangle to triangle, creating new edges as necessary, until the second 
projected endpoint is reached. The "surface walk" process is guided by the cutting plane P 
computed in the cutting plane selection process 440. The projected vertices 555 and cutting plane 
P are highlighted in Figure 9. The annotation reconnection process 450 will create new edge 
segments 920 as it walks from triangle to triangle along the surface of the model 510. In this 
example, the reconnection process has created six new edges which represent the draped original 
annotation edge. 

Pseudo-code for the annotation reconnection process 450 is included below. The input for this 
process are the projected annotation edge vertices (pi, pj), the surface triangles (ti, tj) that contain 
pi and pj, and the valid cutting plane (cutPlane) selected for this annotation edge. The 
IntersectSurfaceWithCutPlane function intersects the cutPlane with the surface triangle startTri. 
The routine computes and returns the intermediate point (tempPoint) and surface triangle 
(tempTri) during the surface walk from pi to pj. The OutputDrapedEdge routine stores the newly 
computed draped edge in the computer's memory for later rendering. 

AnnotationReconnectionProcess(pi, pj, ti, tj, cutPlane) 
{ 

/* 
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* This process outputs the new draped edge segments for the current annotation edge; 

* pi, pj are the projected annotation edge vertices; 

* ti, tj are the surface triangles that contain pi, pj; and 

* cutPlane is the cutting plane selected for this annotation edge. 
*/ 

if(ti = tj) 
done = true; 
else 

done = false; 

startPoint = pi; 
endPoint =pj; 

startTri = ti; 
endTri =tj; 

while (not done) 



IntersectSurfaceWithCutPlane(startTri, cutPlane, tempPoint, tempTri); 



OutputDrapedEdge(startPoint, tempPoint); 
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# # 

startPoint = tempPoint; 
startTri = tempTri; 
if (startTri = endTri) 
done = true; 

} 

OutputDrapedEdge(startPoint, endPoint); 

} 

Alternative uses and methods of simplifying the results of this invention are disclosed and claimed 
in U.S. patent application number xxx, entitled "SYSTEM AND METHOD FOR THE 
COORDINATED SIMPLIFICATION OF SURFACE AND WIRE-FRAME 
DESCRIPTIONS OF A GEOMETRIC MODEL" to Horn et. al, and U.S. patent application 
number xxx, entitled "APPARATUS, SYSTEM, AND METHOD FOR SIMPLIFYING 
ANNOTATIONS ON A GEOMETRIC SURFACE" to Suits et. al, which are filed on the 
same day as this disclosure and are herein incorporated by reference in their entirety. 
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